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ABSTRACT 



This study vras undertaken to exanvine the relationship 
between the rating professors received' .from their students an^ (a) 
selected professoi and student characteristics, and (b) extenuating 
circumstances fr^^uently expressed by instructors*. Data wer^ gathered 
in the sping'of ^91^ f rom an^<iinstitution-wide administration of -a 
rating scale in 253 classes.' Independent variabJ^'s examined included: 
class size and composi'tion ; instructor's rank,^ length of service^ 
willingness to publish results; and five extenuating circuiistances . 
Descriptive and correlational procedures were used. The i'mpXications 
of the results for administrative ^and instructional decisi^jfi-makers, 
faculty .a^mbers^ and higher education in general are discussed. 
(Author/B'3G) 
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■ ABSTRACT -« • 

TWs study examined the relationships between student ratings that 

college faculty members received from their students and a variety of 

independent variables. Major independent variables in this study were* each 

faculty member's willingness to publish results of student ratings, expei^J- 

ence (as evidenced by rank and highest degree held), size of class (both a 

♦ 

2- and ^-ca-tego ry indicator) , and five instructor defined extenuating cir- 
cumstances. The subjects were 91 faculty members at a small publ ic' 4-year 
college whose academic rank ranged from the .level of in'structor to full 

professor.* Correlational and descriptive techniques were used in analyzing 

< - • 

data from 4,285 separate administrations of a faculty rating scale'. 

The overall results of the present investigation provide evidence in 

support of the contention that student ratings of instructor per^formance 

are either influenced by or related to a number of variables. Four general 

conclusions were suggested: (a) there was a si i^h^ negati ve relationship 

between a faculty member's willingness to publ i sK resul tS~of student ratings 

and the atta'ined student ratings; (b) there was also a slight negative rela- 

tionship^ between class size and ratings attained; (c) there wa» no relation- 



ship demonstrated between student ratings and instructor's experience as T 

defined by ran'k and highest degree held; and (d) there was some il|idication 

that there may be a significant relationship between several instructor 

, ^ • ^ ' . ^^^^^ * 

defined ext^uating circumstances and attained student rat ings. f Jlhe f i rst 

- r \ ; k , 

.three of these findings haVe relevance for previously reported -t^j^^Jfcirch 

' 7 '■ / ^ 'Mk^'-' 

findings. Whi le ♦the .f Leadings regarding the extenua.tifig ci rcums£pnjce^ ,were 
not definitive, they do lend support Tor further examination intfep^tfiveapc^ls r bl 
influence of such factors on student ratings of. instructor pe rf ormahce\Jl| 



This study is an investigation of the relationships between the ratings 
given to college faculty members by their students and a variety o'f independent 
variables. Some of these variable's have been examined elsewhere J[i.e., 
faculty member's rank, highest degr-ee held', and class size) while others 
.have been the subject of little or no research (i.e., faculty member's, 
willingness to publish results of student ratings and^ f n/e Instructor^ 
defined exteriVating circumstances). 'In addition to reexamining the pre- ^ 
viously researched factors, the study represents the first attempt to look 
at the relationship between student ratings and a new category of extenua- 
ting circumstances. This line of inquiry h^s become more important in light 
of the movement in higher education toward more extensive use of student 
ratings in the promot ion/ten-ure process., ,1^ 

In September, 1973, the Teaching Research Division of the Oregon State 
Syste'm of Higher Education (OSSHE) began a 3-year study of the factors which 
Influence promotion' and tenure i^n higher education. Th<e study is supported 
by a» grant from^e fund for the Improvement of f psfseconda^y Education 
'(HEW) and is conducted as a part of the Division's Higher^ Education Research 
Program. The basic intent of this larger. study is to develop a. higher 
degree of understanding of the consequences, resulting fro'm present poli^'qies 
and procedures surrounding the assessment of faculty performance, while ' 

making attempts to assist OSSHE institutions in making any necessary define- 

I 

^ents in existing practices. To date, a number of data sources naye been 

* ' ^ • . • ^ ' L 1 

used. A pr imary**source has been admin i sirators at the/ institution and 

if , 

department levels. These admi-n ist rators su^ipl'ied policy statements, guide- 

/ ' ■ . ' ' . .1 

4 

lines,, terms, arid indicators used when they assess faculty performance. The 

• ' \ 

second major source of data was a system-wj de , survey - whi ch evaluatied the 



pronation/ tenure process fro{n 'faculty^ members ' perspectives. .Finally, many. 

of the campuses used faculty review coning tteesVet the departr^nt level and' 

... . ^ ' 

then at intermediate levels on* up to the president df -the iTist i.tiit ion . \ 

'Where such campus-wide personnel committees or advisory bodies existed, *, 
project staff have interviewed these individuals, raising a number of 
questions about those features of the promotion/tenure process which they 
find thje most use/ul and about those features which they deem to be irr 
considerajDle need of change. ^ '/ 

Difring the course of ^ese system-wide data collection efforts*; both 
'teaching and administrative faculty voiced a number of concertos ^bout ttie 
ramifications of the use of student rating 'data in the promot ion/ tenure 
process. It soon b.ecame ev indent that, many of the expressed concerns were 
a direct result of a general lack of famifi.aYity with available research 
which examines the relationships between, var ious factors- and student ratings 
However, a number of faculty members were concerned about. the ppssible 
influence of a number of extenuating ^ci rcumstances on student ratings which 
they felt could be of legitimate concern to a faculty membe;? whose ratings 
may be used in the promotion/tenure process. The present study constitutes 
an attempt to begin to clarify the degree of legitimacy surrounding these 
extenuating circumstances. The results of the investigation should. bfe of 
interest to teaching and administrative faculty, regardless of wKether or 
not the extenuating circumstances tend to result in significantly different 
student ratings. The important point here is that those who are charged ' 
with the responsibility of promotion and/or tenure decisio''ns should know 
which, if any, of the extenuating circumstances appear to have impact upon 

student ratings and are therefore legitimate concerns, antfrwhiK:h are not. 

ft 



Previous research (Hei Iman .6 M-mentrbut, I936; Love) 1 S Hanner^ 1955; 
McDaniel S F^^dhusen,^ 1971) has yieldea' resul ts V(h i ch suggest that there 
' may be a slight neigative,, correlation between class size and student ratings. 
Guthrie ( 1 95^)^ concl uded that there was no correla.tion between^size of 
class and ratings, while other studies^have Indicated that there may be a 
''variable relationship (Gage, I96I; W9od, Linsky, S Straus, 197^). 

With regard-^ the association t^etween a facul ty, member' s experience 
(usually represented by rank) and student ratings, the relationship is 
unclear/ Langen (I966) ^reported^^a positrve correlation between rank and 
ratings. .Conversely, a study by Riley, Ryan, 5 LIfschitz (1950). suggested 
a negative correla^^ion between rank and ratings. The presen^ study examines 
the relationshipship between faculty members' experience and student ratings 
usiag two Indi cators' (viz. , faculty member's rank and faculty member'^s 
highest degree held). ^ \ ' ' 

* ^ * • * 

t 

Method 

Subjects 0' 

A * 

The subjects v^ere 91 faculty members at a small public ^-year coTlege ' 

'whose aGadepiic rank ranged f rW the level of Instructor to full professor' 

(^ instructors, ^6 assistant professors, 21 associate professors, and 20 

full >rofessor^) All subjects were voluntary participant^, In a campus-widd^ 

administration of a'student rat ing Ita 1 e. Approximate ly. 60%. of the faculty, 

JTiembers at the Institution partfici pated. In the evaluation. Data were 

collected Ih May, 197^, in 253 classes during the seventh week <fef instruction. 

• « 

Ins t ruments » • 

- » ^1 

During the winter quarter of the 1973-7^ academic year, the institution's 

' * 1, 

Faculty Senate established a Joint Faculty Evaluation Committee. TITi;3* 



committee was* comr^osed of six faculty members and six studdlits. The author 

who was not a member of the faculty, was .asked'^to^ serve as- a consultant to " 

the committee. Consultation was prqvi'ded in the areas of faculty rating' 

scale ^election, administration, and ^naly^v{s^. The primary objective o.f 

this committee was to devise a complete stucjent rating system for annual, 

*campus-wide use. Subsequent to examination of a-^variety of existing student 

rating scales, the committee decided that none f-ully met the needs of 

faculty evaluation At their sgecific Insti-tutioQ.- The committee dec'hded to 

* - *- 

^develop its ov/n rating scale by combining items from three rating scales. 

The resultant rating scale consisted pf four sections^ The first 
section conta+i^ed 13 items intended far campus-wide use^^ ( 12" speci f i c items 
and 1 overal 1 • instructor performance item).. Prior/tQ selection, ^ach . 
potential i tem was examined in an attempt'Qb e him i-nate' those- ttems which 



might result in an unfair ajdvantage .or di sad/ahtarge for a faculty member 
because of his major discipline and/or course assignment. * I n ^addi'tion , 
eacK ilem was designed to avoid requestl^ng- any information from the student;, 
that woujd require judgments about t/i/^fee 1 i ngs' or ' att i tu^es of classmates. . 
• Each of. the 12 specif i^t performance items was tied td" a Li ker t-t^ype 5-point 
scale, which ranged from a low of .'M*' (strongly disagree) to a high of' ^ 

'•-'5" (strongly agree). . The second and third section of the total rating 

- ' . ^ •/ ' • ^ \ - ^ 

scale were optipnal department/ and instruc-tor segments , 'respectively. A 

final section 'provided an avenue students could use to supply written' 

\ ' I " ^ ' , ' ^ ^ 

comments di rectly to thei r^Jns tructors . Only the i n|t i tution-wixJe items, 

constituting section l^were analyzed in this study. 

The content of the 13 Items was as follow?: *^the instructor seems to 

be knowledgeable in tbe subject area with which the course deals'*; "the ' 
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instructor has effectively presented the suBject matter .to be learned (in 
. this evaluation, 'subject matter' may* mean facts; ski 1 1^ , insigh-ts , and/or 
attitudes)"; *^the instructor seems to be genuinely interested in the 
subject matter"; "the instructor seems to be genuinely interested in the^ 
students' learning the material*'; "the instruetor is someone 'f would feel 
' comfortable approaching to ask questions or to discuss ideas relating to ^ 
the subject mat^r^';^ "the instru<^tor has been reasonably accessible to me ^ 
outside of class ('if you did. not try to contact the instructor, leave 
this item blank)"; "the instructor seems to be serrsftive tQ the responses 
of the class"; "the course seems to be sufficiently ri.gorous (challenging)"; 
' ' ^'the instructor has presente'd material which I think is relevant (within 
,the J imitations impo5.e'd by the** subject)"; "I . have leaVned ^ great deal in 
this bourse ; "/ny interest in the subject matter has increased as. a result 

♦ - • • 

of,. taking this course"; ^nd "the instructor has been fair in the selection 
^ ^ or -examination questiof>s and/or eva 1 uat i on^ cr i teri a used in Ihis courses" 

. %^ • ' '-^ ^ ' 

The overall (general) rating item was,' "Rank the instructor on" the followinq 
scale: 1 = unacceptable, 2 = below standard,' 3 = standard, k == above 
stan<lard, and 5 = outstanding." 

/. ^ J'ns.tructor Data-sheet was used to collect information from the, 
^faculty members about "both class-related characteristics and instructor 
defined extenuating circumstances. * ' • 

Procedure ^ ' ^ . ' 

Approximately ten days before the we'ek of the evaluation, all 'faculty 
^ .members at the institutions-received a copy of a memorandum .from the committee 
Which ^sked if they, v^enewi 1 1 ing to participate in .t^e eva luatf^n, and if they 
were wilting to release the resulti^r^ dSta for publication by the stud^t. 



-7- 
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body gavernment. Each parti.clpat ing faculty member- v;as requested to Identify 
a student administrator for each of his classes. These 'students were 
responsible for 'the actual admi n i st ra.t ion of the rating scale. Several 
student administrator orientation sessions were held the week before the 
evaluation for the purpose, o/ familiarizing 'them with the process they were 
to follow wh6n administering the rating scale in their classes. Detailed * 
dUmln jstration instructions were provided orally at these sessions. The 
student'administrators also received written administration instructions, at 
the' time they picked up the rating scale packets,, immediately pnior to the- 
time of the evaluation in their respective classes. 

Each rating scale packet contained sufficient copies of the rating scale, 
machine'processable answer 'sheets , blank sheets of paper for written comments, 
and pencils. In addition, each packet contained wri tten^ administration 
directions for the student administrators and an Instructor Data Sheer. Each 
returned packet was hand checked by the author to verify that the students 
had correctly coded their course identification information and evaluative 
responses (students responded anonymous ly— however, 95% also answered five 
descriptive items which provided information about. their personal charac-^ 
teristics;. The percentage distribution of these key background variabiles 
(i.e., dlass standing, overall GPA, required or elective course, age, and 
sex) w^re compared with information published by the Registrar's Office onj 
the same variables. The distribution, corresponded quite closely between 
the two data sources for each variable. All of these data were machine 
scored and merg&d with information, provided by the appropriate faculty 
member about each class. These combined data provided input for both, the 
individual instructor reports, which wer6 provided each participant, and 
for the analyses of this study. 

■■*»>., 
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Variables * 

The primary dependent variable used in this study , was the mean student 
rating on t^^ total -scale (items 1 through IZ). Also examined as a dependent 
variable was the rhean^ating received by the faculty member on the overall 
(general)* i tem, ^ . - 

Independent yariables came from a variety X)f sourcesr Of the 10 Inde- 
pendent\ariables included in this study, h came f^rom institutional records 

o 

* ♦ 

and 6 were supplied by participating faculty members. , Institutional records 
provided, data on class size (a ^--category indicator and a 2-category indica- 
tor were constructed) and on faculty members' highest degree and rank, 
Willitlgness to publish results of the ratings .was ascertained fVom the 
original participation inquiry. Data on instructor defined extenuating ^ 
ci rcpajistances was gathered* by meahs of an item on the I nst ruc'tor. Data Sheet 
(a separate sheet was completed for ea'ch evaluated class). The item read 
a,s follows: '^'An inistructor's performance can sometime^ be hindered by 
clrcumstancd. If you feel there are^ cbrrent circumstance^ which may unfairly 
('lower the ratings given you by your students, please* i ndicate them." The 
faculty member vyas instructed td check "Yes" or "No'' with regard to five 
possible extenuating circumstances. These circumstances included: "Work . 
load too heavy to devote adequate attention to the course," ''clas:% Is too 

Urge to adequately present tKe material," "this particular class .is outside 
* f 

' of my greatest competence ^rea ," "this is a new/untried ■ course,'* and 'Snna- 
vations in the instructioR. are being introduced." Space was provided to 
add "other" extenuating circumstances, but none were suggested. 

Ana«l ys i s ' • 

Correlational and descriptive techniques were used in analyzing three 

, different data set^. The firist data set contained responses from ^,285 
» 

' .10 



separate administrations of the faculty rati.ng scale. Thr^ data set served 

two purposes. Fi rst^ it was used to calcula>te' item analysjs information* 

related specifically to the ranting scale. Second, it was 'used to create 

two other summary data sets-"One for courses and one for instructors* ^ The;^ 

course data set pontjained data from 253 courses (prior to'analysis 16 

courses were excluded due to special circumstances). The Instructor data 

set contained one randomly selected course for eaqh of the 91 participating 

faculty members. These summary data seti consisted of: (a) information 

from course and/or instructor summaries of .the ^,285 student responses, and 

(b) course-specific information supplied by faculty members as previously 

described. The coarse data set (237 courses) was used to examine^ in a 

correlational sense> the relationship between class size anci student ratings. 

The instructor -data set, was used to examTne relationships between independent 

variables -r^e la ted to ihstructors, such as, rank, highest degree held, 

willingness to publish results of student ratings, and the five previously ♦ 

descr ibed^xtenuating circumstance items. . . 

■ • . 55 '. 

Results 

Major independent variables in this study were "each faculty member's- 
willingness to publish, results of student ratings, experience (as eyidfenced 
by rank and h i ghest; degree heldH size of, class (both a 2- and ^-category 
indicator), and f i ve' inst ructor defined extenuating circumstances.. Willing- 
ness to publish, instructor experience, and size of class were analyzed ^ 
separately from the exte'nuat ing ci rcumstances . 

" Wi 1 1 irfgness to PubTish, Instructor Experience, and Size of Class' * 

Table 1 presents correlations between the deper(dent and independent/ 
variables using data from the Spring, 197^, student evaluations of , 

,11 



^ . , Cofjjela'ttons between Selected Variables Uiing 0«>ta, from the 
5 Spring^ l9?A;Sfudent Evaluations of Instructor Performdii.cc ' 

Variable Description' . 'A^' " Row Variable Number 
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1. -> Hean rdt^lng on-, totol scale ^ 

(12 items) . - . • - ' * d 

2. Hean rating on an overall * ^ 
(general) item , • '>\ ^ ^ • ' y .89* 

3i Faculty member's willingness to publish^ ^ ^ 

results of ratings* (l«f3o^2*maybe; 3"yes)\ .I3* 
*^ . ' ^ * ' ^ * 

A. Faculty mender's rank (l»ins true tor; 2»asst. ,< 

prof.; 3«assoc. prof.; A*prof.) /-i > ^ ' --.17 

5. Facul ty member's highest d^gre^ '(I-bacbeldrfs? * ^ 
2«master*s; 3*Ph.D.'> ' . .-y 

6. Class size A (1-1 tq 10;|2-ll to' 30; . " ' ^ 
3-31 to 60; A-over 60) / ' ^ -^,1^ 

\ r ' ' ' , ■ ' 

7^ Class size B (J-30 or less; "• • * 

2-over 30) , I * -.2^^ 

.. . 

I *, • ' * *• ' . 

Correlations above the diSgonal are based upon 91 classes (one class for ea<^ participating ^facul ty member * 
with 7 classes excluded due to special xi rcumstances)^, Correlations'below the diagonal are based upon 237 
clas^&s (one to four classes for ea^h participating faculty member), * ^ 

* ' * . . , ' '1* ■ 5 

* Significant beyond the .05 level.' ' •»h^.'* 




.instructor pepformance, (!or relations above the diagonal w^re^based upon 

31 classes' (one class for each participating faculty member with 7"classes 

' ' ' . • * . < ♦ 

. ' V 

. ' ' ^ , • . > <• 

excluded due to special circumstances). Correlations below- the di^Sgorial^ 
were^based ^ofi/ 237« classes (one to four classes for.^each participating 
faculty member). Res*ultant correlatix)ns wer^^based first on <,one xlass for- 

, ■ ■ ' -L ■ / ' 

each participating faculty member and second on/mul tJ pTe clas^efs for eachx 
part i ci pat irrg faculty member, ;beca use' ^ thr^e of the variables ^\ .e. ^ willing 
ness to publish results of ratirrgs, faculty m'fefnber/s rank, a,nd faculty . 
meoiber's highest degree held)^would have been confouride^d i f , analyzed-,) n*a 
^ si tuat ion" in which faculty members were represented by varying numbers of 




classes. , Likewise, th^ two class §i2e ihdi.ca.t9rs were morfe appropriately 
' * « ' * '. • ' . r . • * :3 ' ' . • 

examined.(|BirTg data' which wereWd'6n'nx)(e thar^.one.c^ass per' faculty ' 

member* . \ ^ ^ 

. Examination e,f TabVe V fftdUates j^_s^^^^^ tbe 
m^an ra(;^-r>gs "ph^the tota I scaTe ,( 1 a") temsf^nd'Vf^e meL Y7ting on/tKv^ra^ ^ 
instructor ,:atiftg iYem 1. 89 fc>r Wmul t i p% class d^ta set -vs.. .92 for the ' 
single class data s.ef). fh i s'' Xmp_ I i e s tliat li theP.score, could have' been " 
.validly used- as a criterion cne^sure against -which' to evaluate the relation- 
ship betwee^? the indepdident variables of interest and . the .dependent Variable 
(student ratings). Note that in both datavs^ts each of tfie independent vari- 
al^l^'.s two cot-relations with the two dependent va/iables exhi-bited extremely 
,^ligh^- variations. ^ Therefor/, for the sake of simplicity the folliwing 
discus.sions will focus primari^ly on the relationships between the independent 
. variabiles an6 the mean rati.ng on the total scale 

'^''"ngness to pubfish results. Examination of Table 1^ shows that ther^. 
was a cor.relafion of .ih between. faCuUy member's willingness to publish 
resuUs of^student ratings and the'mean rating on the to^tal rating scale. 
^ This. suggests that fa c.u 1 t-y. members who, for one reason or another, did not 
release their data for-publ-icjatipn tended to'get slightly* lower 'ratings than 
did those, instructors who were wilfi.ng'to have the stJdent government publish 
\the resurts of theiV ratings, (It is important to note that peg-mission to 

publi-sh was; obtained pricy^ to the week of the evaluations.) 
^ ^ Instructor experience. The professoria|jank' which the faculty members 
held and. their hi ghest academic degree were |ised in this study as indicators 
of professionai-lxperience. Examination of fkble 1 indicates thh neither of 
■the^e.indicators were significantly related ^^ttained student ratings. 



Co*rrela t ions fo-r faculty member's rank and highest degree held were -.15 ^ 

apd -.08> respectively. * ' . ^ ' ' . 

: " ^ ^ • . " \ . _ / 

Size of class . Table 1 shows significant negative correlations of 

-,24 and -.23 for the 2- and ^category cjass size indicators,. This ' 

finding indicates that far this sample of faculty members, there was a ' 

o . ' , . • . 

slTght tendency for student ratings- to decrease as class size increased; 

Inrstructor Defined Extenuating Circumstances 

Table 2 presents mean -.ratings and t-scores^ for five instructor defi^ned 
extenuating circumstances. Sin^e most taculty members reporjted .that the exten- 
uating ci rcums.ten'ces dhd not apply,* there was a substantial difference Fn 
the si zes ,,qJ^ th^group. r^^poj^jng- '^yes'"'^ S^'Qup responding *'no." 
For this reason ^t was decided that* a, correlational analy^^^. would be 
ihappropriate because it would tend to obscuFe any existing re^atTonsTi ip-,- . 
due primarily to thfs discrepancy in group si26. Therefore, t was used- 
as a test statistic to test the hypothesis of no 4|fference between the 
means (Blommers & Lindquist, i960). . x * 



Table ? 

Mean Ratings and t- scores «fVr~ I nstru&ior^|jp.fined Extenuatjngr CI rcumstances 



Instructor. defined extenuating circumstance - 


' Heanj rating of' 
group responding' 


Hean r^thig'of. 
group respondfng^ 
"Yes" . " 


' t of dif fere/>ce ^ ^ 
. between 
^ means ^ 


f • 

1. 'Vork load too heavy to devote adequate 
attention to the course" 






. '-.' t^ ^ 

y-x.ik (p < .1) 


,2. "Class too large to adequately present 
the material", , 


'^:>.i 


3.7 


3. "This particular class is outside of my 
greatest competence area" 


jii. 1 




.68 (p < .5) . 


H. "This ^s a new/untrjed course" 


ii.i 




-1.0? (p < .3) 


5. "Innovations In the instructtonare , 
being introduced" 


^1.2 




- U\ (p <• .6) 



* p Is the probability of having t«thls large or larger in slztf'by chance. 



' Exam.i nation of the group n>^ans-io Table,"^ indicates that there was. a . 
tendency for student ratings to^ decrease/ f^.r ,th05e -i nstructofs who said that 
the extenuating circumstances applied to tfiei r parjti cular situati'on. Exam- 
Jnation of the. associated, t-scores^ sugg^^t^. tWa t two of the extenuating ^ 



circumstances produced group mean c^ff ferer>ces s i gni f i can txbeyon^l the .2 "leve 



The remaining. three* extenuating c'i rcumstances 'provi de less ev'rdence of a 
sJgnif/i.Qant relationship between studen,t;j-atihgs>^^ these, extenuating 
circumstances. Vhile these' resalts^aire noj:. de/initi ve, they do lend, support 
^ to further examination into the possfb^e/i^nf lue'nce of'such factors on 
student .ratings of i,ostructpr perforrnao'ce,'. • . \ ' /' 

/ ' /. ' \ Djscusiion • ^' ' . / \- . 

;-'/. . . ^v^, ;\J,. ■ . ■■■ ; ";' \.~'-- • ■■ 

The^overari ■ resuks tfi^e prfesfent investigation provide evidence .in •*. 
support;!offthe' corit4ntjorT,,that ratings of instructor performance' 

are either i^nf licenced. by^^oK'X^^ 'to a nymbe^r of variables. Four general 
concluSjlons 5^re kugg^ted:; y('aXs^he°re was a ^s*l i ght negative relationship* 
between? a^fbcurty meiftbe'r's wi 1 Ll^ngne^6 to publish results of student ratings" 
and the ^attained >;t;uclen,t jjat ings Cb) the ne was al^oNa' slvight negatTive rela- 

*, ' ; '/ ' . ' ^ ^ • * , \\ 

tion^hip betw^e{^"c*l|ass* size and ratings ^tt^ined; (c) there was xio relation- 
$hi> demon strE(t^d\between student ratings .and .instructor ' s experience as v - 
defined by rank aad highest degree he Id ; and""(d) the>Vwas some indicatWn 
tliat there may jt>e' a s r^n i/f i cant- relation:ship between several instructor- . . ^ 
defj'ined extenua^t^lng ci rcumstances and attalne^d student t^tinqs. The first 
tbr^e of these^'fjMI^gs r^Jevance {rfg/. previous ly reported research 

fi\l*ings. With res^rd to the fourth conclusion, the pr^s 



•esent study was hot 



e^Rfected to find c<3.r 



ciJ,n.tl.usi ve evidence ."tfiat^l,!, or even any ^ of-the 



instructor defined^e;^^^^^^^ „e^e significantly related to 

. student ratings of mstrMc:toV^ perform_^_ac.e. W the relationship 

betv/een th|-extenuai;^n5.':ci rcums^ances a^^ ratings is large enough 

to be of ^eal Ftf^ctical^sig^ficance to faculty members, is a question about 
vyhich more data are n-eeded, before any reHable answers can be given.- 

The proposition that studer>ts have the most advantageous perspective, 
'by^.virtue-.of their'daily class.roora-observations, to assess the ijv^class 
•effectrv^ene^s offifeY^^ professors- is the topic of a diminishing amount pf 
..jeb^ter'^'^prehens-ive evaluation of teaching p^^rformance for either salary 

and promotion- considerati^ons or for instructional improvement has become 
.more./and more difj^icuit to achieve and justify unless some type of data from 
'^students is available. Hpweve.r, as ratings become more influential, it 

becomes even.more important. to understand Wh^t it 'is' that enables'an instruc- 
tor or a group of instructor's, to attain good, ratings. 
^ •' -Unfortunately, there has been little research comp leted whi ch deals 
directly wjth adJninistrative uses of student rating data. While the present 
: report also does not 'directly involve dattf emanating from or leading to 
^•administrative use of ratings, the ^resul ts of the extenuating circumstance 
■analyses- are un-ique and should be of direct interest/tp both"*} ndi vi dua I 
facul ty, members, who feel that thei r performance in the classroom can some- 
ijimes^be hindered by ci rcumstance, and- to adj,i nistrators who must interpret 
.he results of student' rat i ngs . . ' _ ' 

The fadt that 'the focus of this study is studen; ratings should not - - 
•W'Y that such ratings are viewed by "the author as beifig the sole, or even 

•fie most justifiable, indicator of teafltng performance, in an overall 

\\\ ' ' " ■ ' " • • 

/l^c IS. on-making scheme. It is recognised, that the. totak performance ol] an ' 
iptructor -is a function of a variety of very different types of behavio.rs. 



Performance In the classroom per se merely part of a professor's role 
that can be reflected in student ratings. Data which relate directly t-o j 
facul ty jnembers/ classroom perforjnance (i.e., student ratings) have a 
necessary and justlfjable role to fulfill in the overall assessment of 
professorial performance. However, student ratings should only be used* 
in conjunct ion with 6ther sources of information about instructional -''^ 
effectiveness. ^ 

An argument can be made that this study, because it is the first . ■ 
large-scale look a.t these instructor defined extenuating circumstances, is 
not truly representatiy^e of the actual relat ionsh-ip, between the extenuatirig 
circumstances and stfklent ratings. This seems to be a reasonable argument, 
particularly in ' is^t of:some of the cited limitations inherent within the 
data which, wi thoy6tyc)^'eS.t io^^ the scQpe of the analyses. Therefore, 

it^would be- reasonable to'continue this type of investi gatioa using more- 
precise def i n 1 1 iatis .<;>f extenuating circumstances in conjunction with a 
rating scale aba/uf which faculty are more fami War than they were in the . 

present case, /in addrti.ori, utilization of other techniques' such as ^najfy- 

/ ^ ' ' / * ' 

sis of" variance would add a needed dimensjon to the investigation- that 

/ ^ 

would allow rfiuch more to be said about the legi t imacy^of the extenuating 

L * ' 

circumstances. . ' . • * 

In a pme of growing use and possible misuses of student ratings for 

promot ionVand tenure grant ing purposes , the iden ti f i cat ion^ of rel^v.ant 

extenuating circumstances which may unfairly ij^fluence student ratings,- 

constitutes a step toward a muth needed refinement in the process oV 

evaluating this aspect of faculty members' teaching performance. ^However,. 

in light of the present findings, a large part of^ the.t^sk remains if we 

to^etermine which, if any, of. the often-voiced instructor defined 

^7 




^ extenua ring circumstances are.,.legi timate concerns, and which are not. The 
^fcor point -here is that it* is imperative that further investigation into 
Tna poss.ible influence of extenuating circumstances, such as those examined, 
fn this study, be continued* Until the influence of such factors is 
either confirmed or dis.counted, it will remain^'^di ff i cu j t to equitably 
apply the resUl tsr-of' s tudent ratings in cjec is ion-making processes. 
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